Robust holistic face processing in early childhood during the COVID-19 pandemic.

The timing of the developmental emergence of holistic face processing and its sensitivity to experience in early childhood are somewhat controversial topics. To investigate holistic face perception in early childhood, we used an online testing platform and administered a two-alternative forced-choice task to 4-, 5-, and 6-year-old children. The children saw pairs of composite faces and needed to decide whether the faces were the same or different. To determine whether experience with masked faces may have negatively affected holistic processing, we also administered a parental questionnaire to assess the children's exposure to masked faces during the COVID-19 pandemic. We found that all three age groups performed holistic face processing when the faces were upright (Experiment 1) but not when the faces were inverted (Experiment 2), that response accuracy increased with age, and that response accuracy was not related to degree of exposure to masked faces. These results indicate that holistic face processing is relatively robust in early childhood and that short-term exposure to partially visible faces does not negatively affect young children's holistic face perception.

A neural signature of exposure to masked faces after 18 months of COVID-19.

In the last two years, face-to-face interactions have drastically changed worldwide, because of the COVID-19 pandemic: the persistent use of masks has had the advantage of reducing viral transmission, but it has also had the cost of impacting on the perception and recognition of social information from faces, especially emotions. To assess the cerebral counterpart to this condition, we carried out an EEG experiment, extracting Event-Related Potentials (ERPs) evoked by emotional faces with and without surgical masks. Besides the expected impairment in emotion recognition in both accuracy and response times, also the classical face-related ERPs (N170 and P2) are altered by the presence of surgical masks. Importantly, the effect is stronger in individuals with a lower daily exposure to masks, suggesting that the brain must adapt to an extra constraint in decoding social input, due to masks hiding crucial facial information.

The impact of face masks on emotion recognition performance and perception of threat.

Facial emotion recognition is crucial for social interaction. However, in times of a global pandemic, where wearing a face mask covering mouth and nose is widely encouraged to prevent the spread of disease, successful emotion recognition may be challenging. In the current study, we investigated whether emotion recognition, assessed by a validated emotion recognition task, is impaired for faces wearing a mask compared to uncovered faces, in a sample of 790 participants between 18 and 89 years (condition mask vs. original). In two more samples of 395 and 388 participants between 18 and 70 years, we assessed emotion recognition performance for faces that are occluded by something other than a mask, i.e., a bubble as well as only showing the upper part of the faces (condition half vs. bubble). Additionally, perception of threat for faces with and without occlusion was assessed. We found impaired emotion recognition for faces wearing a mask compared to faces without mask, for all emotions tested (anger, fear, happiness, sadness, disgust, neutral). Further, we observed that perception of threat was altered for faces wearing a mask. Upon comparison of the different types of occlusion, we found that, for most emotions and especially for disgust, there seems to be an effect that can be ascribed to the face mask specifically, both for emotion recognition performance and perception of threat. Methodological constraints as well as the importance of wearing a mask despite temporarily compromised social interaction are discussed.

How does the presence of a surgical face mask impair the perceived intensity of facial emotions?

The use of surgical-type face masks has become increasingly common during the COVID-19 pandemic. Recent findings suggest that it is harder to categorise the facial expressions of masked faces, than of unmasked faces. To date, studies of the effects of mask-wearing on emotion recognition have used categorisation paradigms: authors have presented facial expression stimuli and examined participants' ability to attach the correct label (e.g., happiness, disgust). While the ability to categorise particular expressions is important, this approach overlooks the fact that expression intensity is also informative during social interaction. For example, when predicting an interactant's future behaviour, it is useful to know whether they are slightly fearful or terrified, contented or very happy, slightly annoyed or angry. Moreover, because categorisation paradigms force observers to pick a single label to describe their percept, any additional dimensionality within observers' interpretation is lost. In the present study, we adopted a complementary emotion-intensity rating paradigm to study the effects of mask-wearing on expression interpretation. In an online experiment with 120 participants (82 female), we investigated how the presence of face masks affects the perceived emotional profile of prototypical expressions of happiness, sadness, anger, fear, disgust, and surprise. For each of these facial expressions, we measured the perceived intensity of all six emotions. We found that the perceived intensity of intended emotions (i.e., the emotion that the actor intended to convey) was reduced by the presence of a mask for all expressions except for anger. Additionally, when viewing all expressions except surprise, masks increased the perceived intensity of non-intended emotions (i.e., emotions that the actor did not intend to convey). Intensity ratings were unaffected by presentation duration (500ms vs 3000ms), or attitudes towards mask wearing. These findings shed light on the ambiguity that arises when interpreting the facial expressions of masked faces.

Psychological functioning in survivors of COVID-19: Evidence from recognition of fearful facial expressions.

Evidence about the psychological functioning in individuals who survived the COVID-19 infectious is still rare in the literature. In this paper, we investigated fearful facial expressions recognition, as a behavioural means to assess psychological functioning. From May 15th, 2020 to January 30th, 2021, we enrolled sixty Italian individuals admitted in multiple Italian COVID-19 post-intensive care units. The detection and recognition of fearful facial expressions were assessed through an experimental task grounded on an attentional mechanism (i.e., the redundant target effect). According to the results, our participants showed an altered behaviour in detecting and recognizing fearful expressions. Specifically, their performance was in disagreement with the expected behavioural effect. Our study suggested altered processing of fearful expressions in individuals who survived the COVID-19 infectious. Such a difficulty might represent a crucial sign of psychological distress and it should be addressed in tailored psychological interventions in rehabilitative settings and after discharge.

The McGurk effect in the time of pandemic: Age-dependent adaptation to an environmental loss of visual speech cues.

Seeing a person's mouth move for [ga] while hearing [ba] often results in the perception of "da." Such audiovisual integration of speech cues, known as the McGurk effect, is stable within but variable across individuals. When the visual or auditory cues are degraded, due to signal distortion or the perceiver's sensory impairment, reliance on cues via the impoverished modality decreases. This study tested whether cue-reliance adjustments due to exposure to reduced cue availability are persistent and transfer to subsequent perception of speech with all cues fully available. A McGurk experiment was administered at the beginning and after a month of mandatory face-mask wearing (enforced in Czechia during the 2020 pandemic). Responses to audio-visually incongruent stimuli were analyzed from 292 persons (ages 16-55), representing a cross-sectional sample, and 41 students (ages 19-27), representing a longitudinal sample. The extent to which the participants relied exclusively on visual cues was affected by testing time in interaction with age. After a month of reduced access to lipreading, reliance on visual cues (present at test) somewhat lowered for younger and increased for older persons. This implies that adults adapt their speech perception faculty to an altered environmental availability of multimodal cues, and that younger adults do so more efficiently. This finding demonstrates that besides sensory impairment or signal noise, which reduce cue availability and thus affect audio-visual cue reliance, having experienced a change in environmental conditions can modulate the perceiver's (otherwise relatively stable) general bias towards different modalities during speech communication.

Predicting Obesity Using Facial Pictures during COVID-19 Pandemic.

BACKGROUND: Sedentary lifestyle and work from home schedules due to the ongoing COVID-19 pandemic in 2020 have caused a significant rise in obesity across adults. With limited visits to the doctors during this period to avoid possible infections, there is currently no way to measure or track obesity. METHODS: We reviewed the literature on relationships between obesity and facial features, in white, black, hispanic-latino, and Korean populations and validated them against a cohort of Indian participants (n = 106). The body mass index (BMI) and waist-to-hip ratio (WHR) were obtained using anthropometric measurements, and body fat mass (BFM), percentage body fat (PBF), and visceral fat area (VFA) were measured using body composition analysis. Facial pictures were also collected and processed to characterize facial geometry. Regression analysis was conducted to determine correlations between body fat parameters and facial model parameters. RESULTS: Lower facial geometry was highly correlated with BMI (R 2 = 0.77) followed by PBF (R 2 = 0.72), VFA (R 2 = 0.65), WHR (R 2 = 0.60), BFM (R 2 = 0.59), and weight (R 2 = 0.54). CONCLUSIONS: The ability to predict obesity using facial images through mobile application or telemedicine can help with early diagnosis and timely medical intervention for people with obesity during the pandemic.

The impact of facemasks on emotion recognition, trust attribution and re-identification.

Covid-19 pandemics has fostered a pervasive use of facemasks all around the world. While they help in preventing infection, there are concerns related to the possible impact of facemasks on social communication. The present study investigates how emotion recognition, trust attribution and re-identification of faces differ when faces are seen without mask, with a standard medical facemask, and with a transparent facemask restoring visual access to the mouth region. Our results show that, in contrast to standard medical facemasks, transparent masks significantly spare the capability to recognize emotional expressions. Moreover, transparent masks spare the capability to infer trustworthiness from faces with respect to standard medical facemasks which, in turn, dampen the perceived untrustworthiness of faces. Remarkably, while transparent masks (unlike standard masks) do not impair emotion recognition and trust attribution, they seemingly do impair the subsequent re-identification of the same, unmasked, face (like standard masks). Taken together, this evidence supports a dissociation between mechanisms sustaining emotion and identity processing. This study represents a pivotal step in the much-needed analysis of face reading when the lower portion of the face is occluded by a facemask.

Facemasks and face recognition: Potential impact on synaptic plasticity.

Visual recognition of facial expression modulates our social interactions. Compelling experimental evidence indicates that face conveys plenty of information that are fundamental for humans to interact. These are encoded at neural level in specific cortical and subcortical brain regions through activity- and experience-dependent synaptic plasticity processes. The current pandemic, due to the spread of SARS-CoV-2 infection, is causing relevant social and psychological detrimental effects. The institutional recommendations on physical distancing, namely social distancing and wearing of facemasks are effective in reducing the rate of viral spread. However, by impacting social interaction, facemasks might impair the neural responses to recognition of facial cues that are overall critical to our behaviors. In this survey, we briefly review the current knowledge on the neurobiological substrate of facial recognition and discuss how the lack of salient stimuli might impact the ability to retain and consolidate learning and memory phenomena underlying face recognition. Such an "abnormal" visual experience raises the intriguing possibility of a "reset" mechanism, a renewed ability of adult brain to undergo synaptic plasticity adaptations.

The consequences of COVID-19 on social interactions: an online study on face covering.

The COVID-19 pandemic has dramatically changed the nature of our social interactions. In order to understand how protective equipment and distancing measures influence the ability to comprehend others' emotions and, thus, to effectively interact with others, we carried out an online study across the Italian population during the first pandemic peak. Participants were shown static facial expressions (Angry, Happy and Neutral) covered by a sanitary mask or by a scarf. They were asked to evaluate the expressed emotions as well as to assess the degree to which one would adopt physical and social distancing measures for each stimulus. Results demonstrate that, despite the covering of the lower-face, participants correctly recognized the facial expressions of emotions with a polarizing effect on emotional valence ratings found in females. Noticeably, while females' ratings for physical and social distancing were driven by the emotional content of the stimuli, males were influenced by the "covered" condition. The results also show the impact of the pandemic on anxiety and fear experienced by participants. Taken together, our results offer novel insights on the impact of the COVID-19 pandemic on social interactions, providing a deeper understanding of the way people react to different kinds of protective face covering.

Face Tuning in Depression.

The latest COVID-19 pandemic reveals that unexpected changes elevate depression bringing people apart, but also calling for social sharing. Yet the impact of depression on social cognition and functioning is not well understood. Assessment of social cognition is crucial not only for a better understanding of major depressive disorder (MDD), but also for screening, intervention, and remediation. Here by applying a novel experimental tool, a Face-n-Food task comprising a set of images bordering on the Giuseppe Arcimboldo style, we assessed the face tuning in patients with MDD and person-by-person matched controls. The key benefit of these images is that single components do not trigger face processing. Contrary to common beliefs, the outcome indicates that individuals with depression express intact face responsiveness. Yet, while in depression face sensitivity is tied with perceptual organization, in typical development, it is knotted with social cognition capabilities. Face tuning in depression, therefore, may rely upon altered behavioral strategies and underwriting brain mechanisms. To exclude a possible camouflaging effect of female social skills, we examined gender impact. Neither in depression nor in typical individuals had females excelled in face tuning. The outcome sheds light on the origins of the face sensitivity and alterations in social functioning in depression and mental well-being at large. Aberrant social functioning in depression is likely to be the result of deeply-rooted maladaptive strategies rather than of poor sensitivity to social signals. This has implications for mental well-being under the current pandemic conditions.

Surgical face masks impair human face matching performance for familiar and unfamiliar faces.

In response to the COVID-19 pandemic, many governments around the world now recommend, or require, that their citizens cover the lower half of their face in public. Consequently, many people now wear surgical face masks in public. We investigated whether surgical face masks affected the performance of human observers, and a state-of-the-art face recognition system, on tasks of perceptual face matching. Participants judged whether two simultaneously presented face photographs showed the same person or two different people. We superimposed images of surgical masks over the faces, creating three different mask conditions: control (no masks), mixed (one face wearing a mask), and masked (both faces wearing masks). We found that surgical face masks have a large detrimental effect on human face matching performance, and that the degree of impairment is the same regardless of whether one or both faces in each pair are masked. Surprisingly, this impairment is similar in size for both familiar and unfamiliar faces. When matching masked faces, human observers are biased to reject unfamiliar faces as "mismatches" and to accept familiar faces as "matches". Finally, the face recognition system showed very high classification accuracy for control and masked stimuli, even though it had not been trained to recognise masked faces. However, accuracy fell markedly when one face was masked and the other was not. Our findings demonstrate that surgical face masks impair the ability of humans, and naïve face recognition systems, to perform perceptual face matching tasks. Identification decisions for masked faces should be treated with caution.